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[57] ABSTRACT 

A video processing system including a number of frame 
stores with common highways. A number of input ports 
together with a computer have access to the input high- 
way via buffers and the output ports together with the 
computer have access to the output highway via buff- 
ers. Each port together with the computer is allocated 
sequential time slots of short duration by a time slot 
control. Thus to an operator it will seem that he has 
continuous access to die system. Image planes greater 
than normal frame size can be handled by the address 
control. Additional data paths and processing hardware 
may be provided to enhance the system capabilities. 

36 Claims, 16 Drawing Figures 
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is basically Raster in format. This data may be pro- 

VTDEO IMAGE PROCESSING SYSTEM cessed under software control or completely new data 

may be added. Instructions for the addition and process- 

BACKGROUND OF THE INVENTION i ng of data come from the system computer via control 

The invention relates to the manipulation of picture 5 ^ The asynchronous nature of the system allows oper- 

data by digital techniques. ation over a very wide range of frame rates from stan- 

It is known from British Pat. No. 1,568,378 (U.S. Pat. dard T.V. through slow scan systems such as electron 

No. 4,148,070) to provide an arrangement for manipu- microscopes to line scan cameras. Non-raster type fqr- 

lating picture data by storing the data in a frame store mats such as spiral and polar scans could be entered via 

and giving random access to this stored video data 10 the computer interface. The operation of the above 

during the video blanking time to process this data with system requires timing information which is extracted 

an algorithm. FIG. 1 shows such an arrangement. from the sync information (write genlock), contained in 

In the video processing system of FIG. 1, a composite the composite video input The video information is 

video signal is received at input 9 and applied to video digitized by converting each picture point to an 8 bit 

input port 12 which separates the sync pulses present on 15 word to give 256 possible levels (e.g. 256 shades of 

the incoming video. The incoming video is converted grey). The digitized data is written into locations, speci- 

from analogue to an 8 bit digital word within input port fied by an address, within the frame store. The timing 

12 and the digitized output 13 is applied to a frame store information extracted from the sync information is used 

and control 15. The detected sync pulses on the incom- to define the address. This timing information gives 

ing signal are used within port 12 to provide timing 20 positional information (start of line, end of field etc) to 

information for clocking the analogue to digital con- cnab i e each picturc point t0 ^ written into the frame 

verter and timing information is also provided at output store m lts cor rect position. 

14 for the frame store and control 15. External syncs The frame store used in this arrangement may 

(genlock) may be provided at input 11 to provide the be of the type discIosed in British Pat . No . 1,568,379 

necessary timing mformation if required. 25 ^ g PjU Nq 4 which riges ^ 

The digitized video samples (picture points) are each made of N channd d ic MQS R A M 

stored in a large number of memory locations within the mt tcd circuits ^ stQre structure fa related that 

frame store and the addresses of these locations are ^ j y raster ^ ^ considered ^ ^ CUDes . 

accessed by the store control in time relation to the M cube holds Qne f ^ fields that ^ a 

timing information from the output of video input port 30 ^ ^ ^ rf ^ ^ ^ ^ ^ 

The digital video held in the frame store is read con- temin f ™ P ic ^ re J™ 1 * ^ j**^ Point is stored 

tinuously to the input 18 of a video output port 19 f s an 8 word 80 s ""* has f 8 * ] ™?- ^ ernatc 

which converts the digitized video data to analogue of m f 0Ted In l f lte ™ t ? fields The two 

form and adds sync pulses from an internal generator to 35 haives of the frame store may be used independently to 

provide a composite video signal at output 20. * tor _ e * w ? ^P 3 ^ * e resolution of which will 

The sync pulses generated also provide timing con- be half the normaL Spending upon the resolution re- 

trol for addressing the store locations to read out the <} uired ea( * "d m ^ s . torc separate pictures (up to 

stored data. External syncs (read genlock) may be ap- 8 1 blt resolution pictures). The frame store can 

plied to port 19 if required. The composite video can be 40 accept vldeo at 10 MHz (15 MHz max) sampling fre- 

displayed on a conventional T.V. monitor 22. quency and reproduce it for display at the same rate. 

The basic conversion, storage and reconversion of The reading process from the store to the display is 

the video signals can be modified by means of a com- uninterrupted by any computer demands. For the pur- 

puter 24 and computer address and control unit 25. The P<>se of reading from or writing into the store the access 

output 27 of control unit 25 is received by input port 12. 45 ^ <> f the memory is 67 nSec therefore enabling a 

Control unit 25 under computer control can adjust the standard T.V. picture to be easily accommodated from 

number of bits in a word to be used (i.e. up to 8 bits) and toe 512 samples in a line. The computer can only gain 

also decide whether the entire frame is stored. The access to the frame store during the line blanking per- 

computer 24 has access via control 25 control data line K> d - The computer has random access and specifies its 

27 to the store 15. Computer address information from 50 address in an array form. The selected array may be of 

control 25 is received by input 26 of the store. any size from single point to the whole store. The array 

The computer therefore is capable of addressing any selected may also be in any position within the store, 

part of the store, can read out the data and modify the Thus by merely identifying the top left hand corner of 

data and re-insert it via video input port 12. the rectangle and the length of the two sides any ad- 

The computer control data line 27 is also connected 55 dress area is accessible. Computer data is fed in at a slow 

to output port 19 which control can select for example rate (typical cycling frequency of the computer is from 

the field to be displayed and the number of bits to be 500 KHz depending upon whether an array is being 

used. Any required computer peripheral 23 can be at- addressed or individual picture points) and is buffered 

tached to the I/O buses of the computer 24. to be fed into the frame store at the transfer rate of the 

Instead of using the computer to modify the data a 60 system, typically 10 MHz. Thus data is speeded up for 

video processor 28 is provided which contains process- writing out into the store and slowed down to read it 

ing hardware. The processor 28 receives the digitized back to the computer. 

video from port 12 at input 16 and the digitized video The above system could be expanded as explained in 

from the store at input 17. After processing, the data the aforementioned patent to provide full RGB colour 

from output 29 can be applied to the video input port 65 by the addition of two more frame stores. Such colour 

12. pictures could be either entered into the system on a 

The above system is concerned therefore with storing frame sequential basis or alternatively three input video 

video data in a digital form in a frame store which data ports could be provided. 
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OBJECT OF THE INVENTION DESCRIPTION OF PREFERRED EMBODIMENT 

The present invention is concerned with a modified The FIG. 2 arrangement shows one configuration for 
processing system capable of providing greater process- realising the invention using a common highway ar- 
ing power and flexibility than heretofor. The invention 5 rangement 

is also concerned with a processing system which can The incoming video is received from separate input 
modify data at times other than during the blanking ports 1, 2, 3, 4, 5 and 6 by respective input buffers 30-35. 
interval. Tne incoming video can come from any suitable picture 

sources such as six cameras, synchronised with each 
SUMMARY OF THE INVENTION 10 other, using Genlock techniques for example. The in- 

According to the invention there is provided a video coming video information to each port is received by 
image processing system comprising at least one of a the °» ffer s ■» * » digital data (having been converted 
data input port and a data output port; a plurality of from analogue to digital form as necessary). The buffers 
frame stores each capable of storing data equivalent to 15 operate as input multiplexers by assembling the video 
a frame of video information; a common input highway 15 data m * * lt dl 6 llal *>™) mto blocks of 8 pic- 

for the frame stores and adapted to receive data for ture points pixels) so as to be in a 64 bit format and 
storage in the frame stores; a common output highway P"™* * 1S d . ata . onto the vldeo data h, * hwa y 56 on a 
for the frame stores and adapted to provide data from «me snaring basis. 

the frame ^nres- nrnee^iniT means adanted to have 7n The tlme Shanng c »P flWrt y « provided by allocating 
the frame stores, processing means adapted to nave 2 0 tf slots to the buffers so that ^ has seqU ential 

access to at least one of the^common input and output ^ tQ ^ g6 fof g ^ ^ 

highways respectively to effect processing of the data din tQ g ictufe ^ ^ { ^ m ^ m fa 

available therefrom; and control means for controlling addjtion tQ ^ . buffefS 3^ buffefs 36 

the passage of the data to and from the common high- afld 3? are ided for ^ b c^n^ 59 via com . 
ways to allow the processing means and the at least one 25 putef interface 5g SQ tnat this also has rapjd and frequent 
of the data input and output port to independently gam access to the input highway 56j ^ ch buffer 36 and 37 
access to the frame stores for a given period on a time allowing the computer data to be input onto the high- 
multiplex basis. wa y m every period equivalent to 8 picture points. In 
BRIEF DESCRIPTION OF DRAWINGS 30 P ractice although buffers 36 and 37 have the capability 

of dealing with blocks of data of 64 bits, due to the 

The invention will now be described by way of exam- relatively slow data handling capabilities of the com- 
ple with reference to the accompanying drawings, in pute r the information actually passed to input buffers 36 
which: or 37 will be of 1 byte. Thus a single picture point of up 

FIG. 1 shows the known video processing system 35 to 16 bit definition can be dealt with for example in this 
disclosed in U.S. Pat. No. 4,148,070; joint period. The allocation of the time slots is illus- 

FIG. 2 shows one embodiment of the system of the trated in FIG. 3. The video data from ports 1 to 6 re- 
present invention, spectively is allocated time slots 1 to 6 and the computer 

FIG. 3 shows the time slot arrangement associated has the slots 7 and 8 (i.e. for most significant byte CI 
with the FIG. 2 system, 40 and least significant byte C2). The time slot allocation 

FIG. 4 shows an input buffer with the time slot con- then repeats. Because the 8 picture points pass as a 
trol in greater detail, single block of data onto the input highway, although a 

FIG. 5 shows examples of possible image plane con- time slot is equivalent to 8 picture points (data wise) the 
figurations; actual time allocation need only be the equivalent of one 

FIG. 6 shows a mechanism for calculating the rele- 45 P^ure point so that all the 8 buffers are sequentially 
vant frame address for a particular location with the 6 iven access to the highway in the period equivalent to 
image plane- 8 picture points, although this could be varied if desired. 

FIG. 7 shows the various calculations achieved by ™ e * me s,ot f m determined by time slot control 64 A 
the FIG S arrangement- plurality of frame stores in the example 10, are also 

FIG. 8 shows the construction of a variable digital *° connected to common input highway 56. Each frame 
. . & store would typically have sufficient storage for 

« . 1^ r , 5 12x5 12 picture points (pixels) each of 8 bit resolution. 

FIG. 9 shows additional facilities for monitoring an Data Qn £ high ^ ay ca ^ be stored in my of the frame 

en ii»t ,n ! a . Se L P V r~r~ + . stores 38-47, the store address control 65 allocating a 

FIG. 10 shows the FIG. 2 arrangement expanded to 5$ particuIar store and an address (j. e . the X and Y address) 
include additional processing capabilities; within the store via address highway 66 for a given time 

FIG. 11 shows the system timing interrelationships; slot ^ nitrated in FIG. 3. In practice, each of the 8 

FIG. 12 shows an example of a Kernal matrix used picture points entering a given frame store is allocated 
for image enhancement, to one of 8 store sectors within that frame store to allow 

FIG. 13 shows in detail the operation of those ele- 60 tne data to be at a rate compatible with frame store 
ments of FIG. 10 associated with this spatial filtering handling capabilities as described in U.S. Pat. Nos. 
enhancement; 4,148,070 and 4,183,058. The writing in of data into the 

FIG. 14 shows additional processing units between system is determined by timing block 61 which pro- 
the early and late buses; duces picture point clocks for time slot and address 

FIG. 15 shows the operation of the bit droppers of 65 controls 64 and 65. The timing is synchronised to in- 
FIG. 8 via the control bus, and coming data by means of the reference information 

FIG. 16 shows the configuration of the output LUTs received by sync separator 60. These syncs can be pro- 
to achieve multiple output transfer functions. vided directly from the picture source as Genlock sig- 
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nals, or derived from the sync information available 
from the incoming composite video in normal manner. 

Although 10 frame stores are shown for simplicity 
they can be expanded as required and can be accommo- 
dated on the common highway 56. Because the high- 5 
way is common to all inputs there need not be a specific 
relationship between the number of inputs and the num- 
ber of stores. Up to 256 frame stores could be accommo- 
dated with the arrangement shown. 

The data held in the frame stores 38-47 is available 10 
for read out for a given time slot onto the common 
output highway 57 under the influence of the read ad- 
dress given from control 65 via highway 66 shared by 
the stores. The output buffers 48-55 have access to this 
data dependent on their allotted time slot determined by IS 
control 68. Thus the first time slot is allocated to buffer 
48 to hold data on 8 picture points and reformat the 
data. In other words this buffer operates in the reverse 
manner to the input buffer. The data from the buffer 48 
is provided at output port 1 for display (reconverted 20 
into analogue form as required) or for external manipu- 
lation. Similar operation takes place for ports 2 to 6 via 
the remaining buffers. Output buffers 54 and 55 are 
provided to allow the computer to gain access to stored 
information via the output highway. These buffers can 25 
be given access to stored information originally sup- 
plied either from the input ports 1-6 or previously en- 
tered from the computer 59 via interface 58 along the 
common input highway 56. The data fed into the system 
via computer 59 may have been received by an external 30 
peripheral 67, such as a magnetic tape device with slow 
scan video data thereon. As the data captured by the 
output buffers 54 and 55 may comprise the blocks of 64 
bit data these may be sequentially read out to the com- 
puter via interface 58, so as to pass on all of the 64 bit 35 
data in that block. 

The system of FIG. 2 operates in a synchronous man- 
ner, the read and write timing blocks 63 and 61 receiv- 
ing timing information from separator 60. Delay 62 is 
provided to introduce a fixed differential in the frame 40 
timing between read and write, this being typically 
equivalent to a period of several picture points, for 
reasons discussed in more detail below. 

The computer interface 58 has timing information 
supplied to it from blocks 61 and 63 respectively so that 45 
it knows when to pass data to the buffers 36 and 37 and 
when to expect data from output buffers 54 and 55, the 
interface 58 itself providing a buffering function. Such 
computer interfacing is well known, see U.S. Pat. No. 
4,148,070 referred to above for example. 50 

The system shown in FIG. 2 thus allows access on a 
time sharing basis from a number of sources connected 
to ports 1 to 6 to allow real time storage in store loca- 
tions allocated by control 65 and passage of stored data 
to the output ports. In addition manipulation of video 55 
derived data by the computer is also possible, which 
data may have been entered via the ports 1 to 6 or via 
the computer. The output ports may also gain access to 
stored data previously entered or manipulated by the 
computer so as to allow display of this information. 60 
Because of the time slot allocation, a number of inde- 
pendent operations can be produced effectively simulta- 
neously and the data Handled in these time slots can be 
from the same or different pictures. 

Such an arrangement allows great flexibility to be 65 
achieved as data need not be pre-assigned to any partic- 
ular store because of the common highways but typi- 
cally can be assigned by the computer 59 under pro- 
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gram control via input line 69. The data need not be 
accessed by the computer for processing only during 
the blanking interval, as was the operating arrangement 
in U.S. Pat. No: 4,148,070, referred to above, because of 
the time slot allocation. A specific application would be 
to use input ports 1 to 3 to handle the Red, Green and 
Blue data from a colour video source. The Red data for 
example could be passed to more than one of the stores 
as desired. Further, the system allows the possibility of 
expanding the data bit-wise so that 512X512 pixels each 
of 16 bits can be used in place of 8 bit resolution by 
sharing between two stores each handling 8 of the 16 
bits. By using 6 stores it would be possible to handle 
3 X 16 bit RGB pictures. 

Rather than increasing the number of bits/pixel it is 
possible to expand the number of picture elements 
within the normal frame. Thus using 4 of the frame 
stores it would be possible to include 1024x1024 (in- 
stead of 512X512) and then choose the desired area 
within that stored for display: The computer itself can 
have access to the entire 1024 X 1024 locations even if 
all these are not used for the actual display. 

The maximum output frequency for display is 15 
MHz which equals 768 pixels/line of 64 jis for PAL or 
NTSC T.V. This allows 585x768 picture point9 to be 
displayed rather than 512x512 normally expected (if 
the normal picture point and line counters were re- 
placed with counters of 768 and 585 bits capacity as 
desired). If a lower frame rate can be accommodated 
(such as slow scan T.V. with a display having phosphor 
persistance) then it could display the entire 1024 picture 
points without exceeding the 15 MHz rate. 

The construction of the input buffers will now be 
described in more detail with reference to FIG. 4, 
which shows one of the input buffers 30 together with 
the time slot control 64. The buffer includes 8 shift 
registers 70-77 and 8 registers 78-85. The shift registers 
each receive 1 bit of the 8 bit data for an incoming pixel, 
register 70 receiving the most significant through to 
register 77 receiving the least significant bit. Each shift 
register is itself of 8 bit storage capability. Thus 1 bit of 
8 consecutive picture points is stored in each shift regis- 
ter under the control of the picture point clocks which 
are provided in standard manner from the write timing 
block 61 of FIG. 2. After the receipt of 8 picture points 
a pulse is provided from the divide by 8 device 87 
within control 64. This pulse clocks the data held in the 
respective shift registers into the respective 8 bit regis- 
ters 78-85. Further incoming picture points then pass to 
the shift registers as before. The data in the registers 
78-85 constitutes the 64 bit block illustrated in FIG. 3. 
Each time slot is provided by decoding the binary out- 
put of device 87 into 1 of 8 lines so that the generation 
of time slot 1 therefrom causes a tri-state output enable 
to allow the data within registers 78 to 85 to be available 
to the common input highway 56 of FIG. 2. Dependent 
on operational requirements, the registers 78 to 85 may 
have more than one 8 bit storage location so that one 
location can be available to receive data from the shift 
registers whilst another already holding data can be 
available for exit to the input highway. 

The picture point clocks, the output from divider 87 
and one of the respective outputs from decoder 881 are 
made available to the other buffers 31-37 of FIG- 2. The 
output buffers 48-55 and the time slot control 68 are of 
similar construction, although the operation is reversed 
in that data passes to the registers as a block of 64 bits 
which is then entered into the shift registers and shifted 
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out picture point by picture point under picture point and 13 need not be present in the displayed image. For 
clock control. The input and output buffers which are the system to operate automatically it is necessary to 
dedicated to computer use can be simplified if desired include a mechanism (e.g. within address control 65) 
by omitting the shift registers so that input data for capable of determining from the selected joystick win- 
example from the computer is passed directly to one of 5 dow position the relevant frames and more specifically 
the registers equivalent to 78 to 85 by using a 1 of 8 the desired picture points within the frames to be ac- 
decoder driven directly by the three least significant cessed to construct the desired frame. A way in which 
bits of the computer address. In such a configuration the correct addressing can be computed is shown in 
interface 58 would also provide a signal to indicate FIG. 6, which now constitutes the address control 65 of 
which I framestore sector of 8 should be "write eri- 10 FIG. 2. Its operation will be considered during a read 
abled". Similar comments apply to data passing from time slot during which it receives read clocks from read 
the output highway 57 to the computer. timing block 63. The arrangement would operate in a 
fMArc or a itcq similar manner in a write operation in which case clocks 
iMAub rLAMbo are received from timing block 61. 
As already explained, the system of the above form 15 The display address counting (512 picture points, 
could be constructed to incorporate up to 256 frame although this could be expanded if desired for reasons 
stores sharing the common highway using appropriate described above) is provided by X and Y counters 160 
time slots and addressing. and 161 respectively. These counters respectively re- 
By producing a system incorporating common high- ceive the normal picture point and line clocks from the 
ways and frame stores it is possible by manipulating the 20 read timing block 63. To allow for possible scrolling an 
addressing provided by control 65 to provide additional X and Y offset selector 162, 163 respectively is also 
facilities for varying the storage allocations of data and provided to generate the desired offset dependent on 
the portions of that data retrieved for further, processing joystick position for that particular time slot. Thus these 
or display. Areas which make up a given picture of selectors may comprise RAMs with offset values de- 
interest will be referred to as image planes. It is possible 25 rived from joystick positions stored therein and one of 
to define the image plane to be used as now described to which is output in dependence on the time slot number 
allow areas within specific pictures to be looked at (1 of 8). The maximum offsets for a 256 frame store 
dependent on manipulations carried out within address system (16 X 16) would be 8192 pixels. Thus returning to 
control 65. the FIG. 5 example the X offset position has been se- 
FIG. 5 shows three examples of image planes selected 30 lected to be equivalent to 620 pixels for image plane no. 
from a possible 256 frame area which could be handled 1 chosen for the first time slot say. The Y offset selected 
by increasing the number of frame stores from 10 to 256. is equivalent to 800 pixels for the joystick position 
These additional frame stores would simply be added to shown in the first image plane. The X and Y counters 
share the input and output highways 56 and 57 and the 160 and 161 are incremented picture point by picture 
write/read address output 66 from control 65. Even 35 point such that the resultant address for X and Y respec- 
with the 10 stores shown image planes of a size up to 10 tively is provided by adders 166 and 167 which takes 
frames can be constructed. A plane could be equivalent into account the actual count plus the offset. In this 
to all ten frames down to single frame size. example the X and Y address are 108 and 288 respec- 
A large selection of predefined image planes could be tively and are identified by J and K in the image plane 
stored within address control 65 for example each iden- 40 no. 1 of FIG. 5. Thus this address for X and Y is made 
tified by a number which on entering the identification available to the address highway 66 for that time slot. In 
number would cause the system to select that image addition the frame number is required for which that 
plane with the predetermined dimensions. In this exam- particular address is to be used and its computation is 
pie the first image plane comprises a group of 20 stored now explained, with reference to FIG. 6 and FIG. 7. 
frames (frames 1 through 20) of the possible 256. In 45 As already mentioned, the operator can define a list 
image plane no. .2, the image plane comprises 16 stored of image plane configurations, examples of which are 
frames (frames 21 through 36). In image plane no. 3, 6 shown in FIG. 5 and he can choose to use a particular 
stored frames are present (frames 37 through 42). Al- image plane for a given time slot which plane is identi- 
though the three examples have image planes consti- fied by its image plane number. The number of the 
tuted by data from dissimilar frames, this is not neces- 50 image plane selected for each time slot is entered into 
sary and another image plane could be constructed from plane store 165, which number could simply be selected 
say frames 19-22. As already explained, because of the using standard digital thumbwheel switches for example 
eight time slots, a different selected image can be pro- or conveniently using the computer keyboard. The 
cessed during these respective time slots. The actual identity of each image plane for each of the time slots 
frame area accessed for a write or read operation from 55 will be output in turn under the control of block 68 of 
within the available image plane is shown by the broken FIG. 2. This data made available from the image plane 
lines and in practice would typically be under joystick number store 165, which, dependent on the image plane 
control. Movement of the joystick will give rise to an X selected, will be used to access frame data from X 
offset and a Y offset as shown. Thus, considering a read length store 168, Y length store 174 and offset store 172, 
operation, for image plane 1 with the frame area ac- 60 each comprising a look up table. These look up tables 
cessed being as shown in the example, then because of may constitute a preprogrammed ROM or a RAM 
the common output highway, data can be retrieved loaded with image plane data via computer 59. Frame 
from frame stores 7, 8, 12 and 13 without problem and quantity X length memory 168 holds data on each X 
the frame so constructed will look like a normal frame length for the respective image planes available in the 
(i.e. although the frame is constituted from information 65 system and in dependence on the identity data received 
from several frame stores, it will not be degraded where will output the desired length (identified as output B in 
information from one frame store ceases and another the list in FIG. 7 and also in FIG. 6). For image plane 
commences. Thus the boundries between frames.7, 8, 12 No. 1 it equals 5 frame stores. Similarly the Y length 
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memory 174 provides the number of frames for that when required to allow single frames to be dealt with, 
particular image plane. Thus for image plane no. 1 this For example, by defining image plane numbers 50 to 57 
equals 4 frames (see output C in FIGS. 6 and 7). (say) to relate to single image stores 1 to 10 (i.e. stores 38 
In practice the outputs A to C of FIG. 7 are fixed for to 47 of FIG. 2) then by choosing image plane number 
a given image plane, with the offsets (D and E) being 5 50 for the first time slot for example then input buffer 30 
dependent on the joystick position or some other means would have access to store 38 alone if no offset is intro- 
for generating the relative quantity used to access the duced via generators 162 and 163. For computer time 
selectors 162 and 163. The computation for the X and Y slots 7 and 8 the display counters 160 and 161 are expe- 
address (see J and K) will be made for each picture diently disabled as shown so that the X and Y offsets 
point following increments of the counters but in the 10 themselves pass without modification through adders 
table of FIG. 7, only the address start for image plane 166 and 167 so that these offsets defined by the corn- 
no. 1 is shown with counters 160 and 161 being zero (see puter in known manner effectively form the particular 
F and G). Similarly with image planes no. 2 and 3 the location to be accessed and in this manner the computer 
start is shown, but for plane no. 3 the end of the frame accesses the frame stores via the image plane mapping 
calculation is also shown to illustrate the blanking as- 15 control 65. 

pect described later. Returning to image plane no. 1, the As each time slot is independent, up to 6 operators 
desired frame number is identified using adders 171 and (using the embodiment of FIG. 2) could be aceommo- 
173 and multiplier 169. The adder 166 produces two dated. Not only do they have the ability to share the 
outputs. The output H produces the quantity of whole frame storage facilities but they can use the same data as 
frames resulting from the summation whilst output J is 20 well if required. If colour operation is required then two 
the *remainder' of picture points from this sum. In this operators could use 3 ports each on a RGB basis, 
example the number of whole frames is 1 and the re- The system described with relation to FIG. 6 has the 
mainder is 108 pixels which defines the X address as capability of choosing the window under joystick con- 
already explained. A similar situation occurs for the Y trol to an accuracy of a single picture point. In practice 
adder 167 giving a resulting 1 for I and 288 for K. 25 because the data being passed to and from the stores is 
This former output from adder 167 is received by in blocks of 64 bits, this limits the window in the X 
multiplier 169 which multiplies this number with the direction to the accuracy of the block (i.e. 8 picture 
output from store 168 and the result is used in adder 171 points). Where there is a requirement to achieve offset 
to which the whole frame X quantity (H) is added be- control to a single picture point, then it is necessary to 
fore receipt by further adder 173. 30 provide a variable delay dependent on the offset re- 
in adder 173 the frame number offset (A) read out quired in order to cause the correct initial picture point 
from memory 172 is added to the output from adder to be the first in a given block of 8. A device capable of 
171. This addition step gives the frame store number (L) providing this operation is shown in FIG. 8. This device 
for which the address is to be associated (in this case comprising 8x8 bit RAM 178, N bit counter 179 and 
frame store number 7 as shown in FIG. 5). This compu- 35 register 180 forms a digital delay which would be pro- 
tation is effected for each time slot and the address is • vided in each of the input buffers and output buffers for 
incremented accordingly. example. Thus considering the buffer 30 of FIG. 4 the 
Whilst the above blocks are all that are needed to RAM 178 would be connected between input port 1 and 
calculate the desired locations, where the joystick or shift registers 70-77 so that 8 bit incoming video data 
equivalent control is allowed to move partially outside 40 passes to the buffer shift register via the RAM. The 
the image plane then additional elements are used to RAM will have 8 possible address locations each for 
provide blanking as necessary (see Y length memory storing one 8 bit word for a given picture point. The 
174, X limit block 175, Y limit block 176 and OR gate address is defined by the output of N bit counter 179 
177 with outputs C, M, N and P respectively). The which output depends on the picture point clocks re- 
output (Q of frame quantity Y length memory 174 is 45 ceived. In the case where N=8 then considering eight 
used for comparison with the frame quantity output (I) Read/Write operations, in the first operation no data is 
of adder 167 to detect in checker 176 whether this for- available for read out but the first picture point is writ- 
mer value remains larger than I and greater or equal to ten into the first RAM location during the write portion 
zero using standard logic techniques. of the cycle. This process continues under clock control 
Similarly the output B of frame quantity X length 50 until all the 8 locations have data on 1 picture point and 
memory 168 is compared with the H output of adder then the counter 179 resets and the RAM is addressed at 
166 to determine in checker 175 whether the value of B its first location once again. This time location 1 pro- 
remains greater than H and greater or equal to zero. vides the first picture point for read out and receives the 
As shown in the last column of FIG. 7, the computa- 9th incoming picture point for storage during this 
tion of frame 45 (see L) is achieved, but due to the 55 Read/Write operation and this process continues until 
presence of OR gate 177, the output P provides blank- all picture points 9-16 are sequentially stored, points 1 
ing during this interval (It is clear from the illustration to 8 having been sequentially read out. Thus it can be 
in FIG. 5 that blanking will also occur during frame 44 seen that the RAM provides a delay period equivalent 
resulting from calculations on the pertinent pixels to 8 picture points. Varying the value of N causes the 
within the desired frame.). 60 delay to be varied. When N=3, the counter only counts 
Thus having chosen the desired image plane, the 3 incoming picture point clocks before resetting so that 
relevant data is accessed from the frame stores and the delay period before the addressing returns to a given 
made available on the common output highway 57 for location is reduced from 8 to 3 picture point clocks, 
receipt by the relevent output buffer 48 through 55. Thus the first picture point goes in location 1, the sec- 
Similar comments apply to the write operation using 65 ond and third into their respective locations, but then 
highway 56. The FIG. 6 arrangement would then use the counter resets and the first picture point is read out 
clocks from write timing block 61 and time slots from and the first location now receives the fourth picture 
control 64. Such an arrangement is still flexible enough point and so on. Choosing a value of N defines the delay 
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required and for a given time slot this value effectively Although the inputs from the buffers are shown as 
controls the offset for that buffer. The value of N for the being directly received by the monitors, in practice 
given time slot associated with that buffer may be these will typically pass via digital to analogue convert- 
stored in register 180. In practice it is convenient to ers and via processor amplifiers where the necessary 
make use of the output of X offset block 162 to define 5 synchronising signals will be added. Normally the 
the value of N for a given time slot. The 3 least signifi- frame numbers within the image plane and the bound- 
cant bits of the offset provided by block 62 corresponds aries on monitor A as the system makes these transpar- 
directly to the value of N up to 8 and the separate regis- ent to the operator need not be displayed. In practice 
ter 180 can be omitted if desired. tne frame numbers and the frame boundaries on monitor 

A similar process operates for the output buffers and 1° B w ou\d typically not be shown, but purely an image 

would be provided between the shift registers (within transparent to any frame edges would be shown, As the 

the buffer) and the output port for example. joystick is moved the image on monitor B will pan or 

The powerful and flexible handling capabilities of the tiJt whilst tha * <> n monitor A will be fixed. If the border 
FIG. 2 arrangement using time slots and common high- defining the selected window is provided this will 
ways will now be illustrated by way of example with 15 change in sympathy with the image on monitor B under 
reference to the FIG. 9 configuration which shows a joystick control. Such a border can be generated using 
digital video compressor 181 connected between the "tandard curser generator techniques. Where an opera- 
output port 1 and the input port 2. A first monitor 182 tor * paling with colour information .additional ports 
is connected to output port 2 and a second monitor 183 can be brou S ht lnto P lav to assemble the desired ,ma S e - 
is connected to output port 3. The address control 65 is 2 ADDITIONAL CAPABILITIES 
influenced by the joystick 184 as described above. Al- A . , . - . Jt _ 
though a joystick has been used this may be substituted . Although the processing pro v.ded by compresso. -181 
by an equivalent manually controlled device e.g. track- sho ™ r ° ub * a f c f ™ m ™ output port and back 

er-ball or touch tablet. Only part of the highways and „ to a " ,n P ut P° rt ° f h j SyS ^ m * ,S °^r process mg 

t\. fc ; , u r r * • 'i J * r 25 can be accommodated within the system itself when the 

part the total number of frame stores are included [for % ement is suitab , modified> To illustrate 

simplicity. Assuming that the system stores ho d data ^ mQ M * ows an ement based on Fia 2 but 

previously entered say via computer 59 which relates to ded t0 include additi * nal manipulation capabili- 

slow scan video information and encompasses an area ^ M Qne of the • flnd t ^ 

equivalent to a number of frames. Choosing a given 3Q with associated components is shown for simplicity as is 

image plane illustrated as constituting frames 1 to 9, onl a single frame store ^dated with the common 

then this entire image plane can be systematically ac- highways 56 and 57 

cessed and passed via the output buffer 48 and the first Composite analogue video information is received at 

output port to the compressor 181 during the first out- ^ f|rst input port and is ^ scd to ana i ogU e to digital 

put time slots. 35 converter 201. The incoming video is also received by 

The compressor 181 is effectively a zoom down de- sync separator 60 which passes the sync information for 
vice which electronically reduces the size of the image use by the store address an d control block for and by 
plane which in this example is shown as 3X3 frames. elements 61-68 of FIG. 2 which provides store address- 
Such techniques of size reduction are already known ing ^ described above for each of the frame stores (only 
from U.S. Pat. No. 4,163,249 and in this instance it will 40 f rame store 3 g is sn own). The addressing can be con- 
require a fixed degree, of compression for a particular trolled when desired both by the image plane mapping 
selected image plane. Larger image planes (see image selected for a given time slot and the joystick control 
plane no. 1 of FIG. 5) will have to receive a greater 134 j n tne mann er already described, 
degree of compression than smaller image planes. The The timing highway available from control 61-68 to 
required degree can be selected from a look up table in 45 computer interface 56, high speed processor 232 and 
the same way as the elements within the FIG. 6 arrange- digital to analogue converter 221 synchronises the sys- 
ment responding to the output of block 165 dependent tem operation. The digital video from converter 201 
on the selected image plane number. The resultant instead of passing direct to input multiplexing buffer 30 
frame reduced from the 9 frame matrix as it is generated passes via recursive processor 209 constituted by look 
is passed into an empty frame store via input port 2 50 up table 210, arithmetic and logic unit 211 and look up 
during the second input time slots. table 212. However, when desired, by suitable setting of 

The stored compressed image can be monitored by the LUT and the ALU the path will be transparent to 
gaining access to this during the second output time the data to correspond to the FIG. 2 situation. Data 
slots and passing this via buffer 49 and the second out- from multiplexer 30 passes to the common input high- 
put port to the monitor 82. 55 way 56. Data read out from the frame stores passes from 

On viewing the compressed image of that image the common highway 57 to output multiplexer (buffer) 

plane on monitor A, this is seen to contain a tree. By 48 and thence via LUT 220 to the digital to analogue 

moving the joystick so as to encompass this portion of converter (DAC) 221. Syncs etc will be added after 

the image plane of interest it is possible to monitor this conversion as necessary to provide composite video, 

tree at full size using the monitor 183. This is possible 60 In practice ADC 201, processor 209, LUT 220 and 

because the output buffer 50 for the third time slots can converter 221 would typically be repeated six times to 

be given access to the same data available in the first provide the 6 input and output ports. Each of the six 

time slots, as data from the frame stores is not destruc- ADC's 201 can provide data onto any of the six early 

tively read out and remains in store unless written over. buses 238. 

Although the frame is constructed from data from parts 65 The computer has access to enter and retrieve video 

of frames 4, 5 t 7 and 8 from different stores the resultant data as before under the control of the multiplexer 36, 

image is not degraded due to the common highway 54 providing input and output buffering respectively. A 

configuration. number of LUT map blocks 225-230 are provided as is 



PACT Vorcinn- 9 fl 1 A 



4,485,402 

13 U 

control bit dropper 231 for reasons described below. A interest so as to result in an enhanced picture. Such 

high speed processor 232 is also shown. The system filtering can be effected on part or all of the frame. In 

includes several buses viz late bus 337, early bus 238, the FIG. 12 example the spatial filtering is shown as 

control bus 236 and M-bus 235 which can be bi-direc- being selected to comprise a matrix of 9 picture points 

tional in nature to allow interaction between the various 5 Pi through P9. To enhance point P5, it will require data 

system blocks to which they are linked. from the 8 surrounding picture points within the Kernel 

M_BUS matrix. Because the system has access to several frame 

stores simultaneously with independent addresses it is 

This bidirectional bus is used to allow data to pass to possible to use recursive processor 209 of FIG. 10 to 

and from the various blocks at computer rate (e.g. 50 10 evaluate the matrix multiplication very rapidly as 

KHz per picture point) or high speed processor rate shown by FIG. 13 which constitutes the relevant circuit 

(e.g. 1 MHz per p.p.). Thus data manipulated by the portions transposed from FIG. 10. thus by scrolling the 

computer 59 can pass to and from this bus via interface ^ by \ p icture po int relative to another it is possible 

56. Non video data from the computer can also use this t0 read out data from the re i eV ant frame store, pass it 

bus, for example to select a given image plane or store 15 v j a ^ e ear j y DUS to the processore 209 so that it receives 

address by feeding the instructions to control 61-68, picture point N to effect tlie desired manipulation 

and for controlling the LUTs. Thus this manipulation where it is mu ]tiplied by coefficient Reelected via the 

bus (M-bus) allows additional system flexibility. M . Bus from the computer . The result passes via buffer 

CONTROL BUS , n 37 to tne stores for storage in an available location and 

... „ . ... i_ for subsequent read out during later steps. So the steps 

This bus is provided to allow date stored within the continue unti , |he entife ffame (if required) is enhanced, 

frame stores to be used as control data to infiuence For fc ^cultr matrix shown the computation 

^lEfT™" ^/ Ch,eved t b y passmg ^ to would proceed as 9 steps as follows where 

control bit dropper 231 to generate the necessary in- r 1™ . 

structions for the LUT map blocks 225-230. 25 



EARLY AND LATE BUSES StepNa 



B| = K\ X A(^i^_i) 
B 2 = B\ + K 2 X A^^-i) 

B 3 = B 2 + KjX A^+ij-l) 
B4 = 83 + ^X^-1,) 
B 5 m B4 + Kj X A(^) 
B6.= B 5 + K6X A^+i,)- 
B 7 =- B 6 + K 7 X A( A ^ + |) 
B 8 = B 7 + K 8 X A (jt ^ +i) 
Bg « Bg -t- K9 + Afr+t^+i) = result 



Although the system incorporates multiple input and 
output video highways 56 and 57 which allows interac- 
tion between channels when the data is in digital form, 30 
by adding two other video buses 237, 238 as shown still 
greater manipulating power is achieved. These buses 
have a fixed time relationship respectively to the store 

input and output timings and can be used for recursive 

video functions. These buses are bi-directional allowing 35 a = original picture dmo 

both feedback and feedforward operation. B = com P uled ■> each 

As already mentioned there is a fixed delay between _ „ _ . m ^ t , 
the commencement of a store read cycle and the com- Thus the first step in processor 209 uses only date at 
mencemeht of a frame store write cycle determined by ln P ut A but the subsequent steps use date from previous 
the delay block 62 of FIG. 2. This situation is illustrated 40 calculations used as input B for summation therein with 
in the timing diagram, of FIG. 11 where the start of a other data - Central picture point P 5 in the matrix is 
read cycle is represented by wave form (0 and the write designated as being at location x,y. 
cycle by waveform (e). This fixed delay may be the The computation of an entire frame will take 9 frame 
equivalent of 15 picture point clocks for example. The time periods (0.36 sec). Similarly a 5 X 5 selected matrix 
start of the incoming video is represented by waveform 45 will take 1 second and a 9x9 matrix will require 3.24 
(a) and this will be delayed by its passage through ADC sees. This is a considerable improvement on known 
201 as represented by waveform (b) This waveform also computer controlled systems which can take several 
represents the timing on the early bus so that both in- minutes to compute such enhancement 
coming and previously stored data can have the same B y inclusion of late and early bus structure, any de- 
timing relationship/ The late bus timing is represented 50 sired processing function can be placed between the 
by waveform (c) and the processor 209 and LUT 220 two as illustrated by the recursive processor 209. 
each will be provided with an inherent delay equivalent In practice the processor 209 can be placed anywhere 
to the difference between the early and late bus timing between the early and late buses as now shown m FIG. 
so as to allow data passage without inteference or deg- Mw A bypass block 239 is then needed to cope with the 
nidation. The delay produced by the passage of date 55 fixed delay period between the early and late timing, 
through DAC 221 is represented by waveform (d). The bypass can simply use RAM techniques for delay- 

The provision of the early bus allows date to be ing the date by a fixed period equivalent to the picture 
passed back and handled by the processor 209 as though point clocks between the two bus timings. RAM delay 
it was incoming date from an input port. The processor techniques are already described with relation to FIG. 
is shown as a recursive processor, but could comprise 60 8. Other hardware processors can also be coupled be- 
other types of hardware providing fixed function video tween the buses as illustrated by the real time, spatial 
rate processing (e.g. 10 MHz per picture point). filter 240 and the multiplier/accummulator 241. A given 

An example of recursive operation is now described processor will have an inherent delay dependent on 

with respect to spatial filtering. how it manipulates the date received. If the inherent 

65 delay is less than the delay relative to the buses, addi- 

(a) Spatial Filtering tionaJ delay a j^j^ ^ be provided for that 

The requirement of spatial filtering is to use data from processor so that it is compatible with the system. This 

adjacent picture points to compute the picture point of also applies to LUT 220. 
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It can thus be seen that it is expedient to have a fixed 
time delay between store read and write cycles of suffi- 
cient magnitude to allow the early and late bus timing to 
accommodate any desired processor whilst maintaining 
rapid operation. 5 

(b) Feedforward to Display 

By using the early bus as a feedforward device it is 
possible (see FIG. 14) to take the incoming data and 
make it available directly for display without intermedi- 10 
ate frame storage. The LUT 220 if required can effect 
output processing on the data prior to receipt by the 
DAC and such processing could include gamma correc- 
tion, transformation, graphical overlay and windows. If 
the processed data is required for retention it can be 15 
passed via the late bus back to the frame stores after 
receipt by the input multiplexer 30 for example. 

The late bus allows the results from the recursive 
processor 209 to be fed forward to monitor the results. 
The processor 209 is capable of effecting other calcula- 20 
tions such as subtraction to operate as a movement 
detector for example and the result displayed via the 
late bus. Any data required for storage can be retained 
by means of the late bus operating in reverse to pass 
data back to input multiplexer 30. 25 

(c) Self-Test 

The buses can also be used to provide a self test capa- 
bility. A selected programme will generate data for 
storage in one frame store and commands the output 30 
processor 220 and allows the resultant data to be fed 
back via the late bus to another frame store. The actual 
result is compared with the expected result to see if any 
errors have arisen. In a similar manner the early bus can 
be used to simulate the ADC output to check the integ- 35 
rity of the input processor 209 and associated elements 
for the input side of the system. 

INSTRUCTION DATA USING THE CONTROL 

The system as described in FIG. 10 has the capability 
of using the integral frame storage to accommodate 
system instructions as though it were normal data. The 
instruction data may switch the entire system into dif- 
ferent states on a pixel by pixel basis using the control 45 
bus. The data from the output buffer 48 is available to 
the control bus via bit dropper 231. The bit dropper 
selects which bits from a particular buffer is made avail- 
able to this bus. 

The instruction data is used to select a particular map 50 
function from map LUT 225-230 dependent on the data 
content on the control bus. 

In practice as 8 bits are required for the control bus 
then 8 droppers will also be used as now shown in FIG. 
15. The 8 bit data from each of the output buffers 48-53 55 
is received by each bit dropper 231A-231H. With 6 
output buffers the total bits available at each dropper is 
48. The bits selected are under the control of the com- 
puter via the M-Bus 235. The single bit from each drop- 
per provides an 8 bit output for passing to the video rate 60 
control bus 236 where it is received by map block 
225-230 which provides the selected function in depen- 
dence on the bus data. Examples of the control func- 
tions are input write protect (via map block 227), recur- 
sive video processing (via map block 226), output win- 65 
dow, cursor or overlay (via map block 230) or video 
path switching (via map blocks 227 and 229) or transfor- 
mation control (via LUT block 220). A given function 
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can change on a picture point by picture point basis if 
required. 

AREA SWITCHING FOR OUTPUT 
TRANSFORMATION 

As already mentioned one of the frame stores could 
be used to define particular areas on the image as dis- 
played on the monitor and this data can be used as 
controlling information rather than normal video data. 
This stored data itself will be used to control the look up 
tables so that different functions will be achieved by the 
look up tables dependant on the particular area being 
shown (see FIG. 16). In practice up to 16 different 
transfer functions could be selected by using 4096 X8 
LUTs and 4 control bus bits. 

GRAPHICS STORE 

By expanding the look up table 220 at the output as 
described above and loading constants into all the trans- 
fer functions except 0 then any combination of desired 
graphics overlay can be accommodated. The output 
will be switched to a particular colour as defined by the 
LUT whenever the graphics overlay is required. Since 
the control bus may receive data from any video store 
then the video store effectively becomes a graphic store 
using the control bus. Thus there is no longer any need 
for a dedicated graphic store. 

HIGH SPEED PROCESSOR 

The high speed processor 232 of FIG. 10 is included 
to allow real or near real time processing. Such a pro- 
cessor may comprise a programmable bit slice micro- 
processor. Unlike previously disclosed processors in the 
video art this processor is programmable and can be 
used to manipulate (image process) the data in the stores 
and also control the system in a similar manner to the 
host computer 59 but much faster (typically 1 MHz per 
picture point). It can be programmed by means of the 
host computer 59. This high speed processor can be 
used for rapidly effecting fast Fourier Transforms, 
image rotation or intensity histograms for example. 

It can be seen that the system described allows great 
flexibility and power of processing. Because of the time 
slot allocation, the system is not restricted to a single 
in/out port with access by the computer only during the 
blanking interval. As the time slots are of short duration 
this allows rapid sequencing and the system can thus 
handle real time data from a number of ports and effec- 
tively continual access by the computer if desired. Thus 
to an operator it will seem that he has continuous access 
to the system even though in practice this access is 
sequential rapid access as far as the highways are con- 
cerned. 

I claim: 

1. A video image processing system comprising: 
a plurality of data input ports and at least one data 
output port; 

a plurality of frame stores each capable of storing 
data equivalent to a frame of video information; 

a common input highway for the frame stores and 
adapted to receive data for storage in the frame 
stores; 

a common output highway for the frame stores and 
adapted to provide data from the frame stores to 
the at least one output port; 

processing means adapted to have access to at least 
one of the common input and output highways 
respectively to effect processing of the data avail- 
able therefrom; 
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control means for controlling the passage of the data 
to and from the common highways to allow the 
processing means, the data input ports, and the at 
least one data output port to independently gain 
access to the frame stores for given time slots on a 5 
time multiplex basis; and 

data buffer means for assembling received data into 
blocks and connected to receive data from respec- 
tive data input ports and from said processing 
means, and to pass received data in blocks to the 10 
input highway during respective time slots. 

2. A system according to claim 1, wherein the control 
means is adapted to allow independent access to the 
highways for a time slot of at least one picture point 
duration in the input data, but of substantially less than 15 
one frame duration in said input data. 

3. A system according to claim 1, including multiple 
data output ports and wherein said control means is 
adapted to allow the output ports, as well as the output 
and the input of the processing means and the input 20 
ports, independent access to the input and output data 
highways for given time slots on a time multiplex basis. 

4. A system according to claim 3, wherein the input 
ports each include a data buffer for receiving and hold- 
ing input data prior to each respective time slot and for 25 
passing said input data in a block to the common input 
highway during said time slot and the output ports each 
include a data buffer for receiving output date from the 
common output highway during a respective time slot, 
and for outputting said output data after said time slot 30 

5. A system according to claim 4, wherein each input 
data buffer is adapted to assemble incoming data into 
data blocks equivalent to the number of picture points 
between successive time slots during which the data is 
passed from said buffer to the input highway. 35 

6. A system according to claim 1, including accessing 
means for allowing data to or from the frame stores to 
be handled so as to define at least one image plane com- 
prised of a plurality of picture points in excess of that 
available from a single video frame. 40 

7. A system according to claim 6, wherein the access- 
ing means includes a memory for holding positional 
information relating to an image plane so as to identify 
the one or more frame stores required to be accessed 
and their relative frame positions for a chosen image 45 
plane and for determining the locations of desired pic- 
ture points within a given frame on a picture point by 
picture point basis. 

8. A system according to claim 7, wherein the access- 
ing means includes an offset generator for producing an 50 
offset to modify the area selected from within the image 
plane. 

9. A system according to claim 8, wherein the offset 
generator is controlled by manually operable means. 

10. A system according to claim 8, wherein adjustable 55 
delay means are provided to delay the passage of data 
for a period dependent on the offset generated. 

11. A system according to claim 8, wherein a blank- 
ing device is provided to prevent degradation of the 
video data whenever the offset causes the accessed 60 
image to move outside the selected image plane. 

12. A system according to claim 7, including com- 
pression means adapted to receive data available from 
the common output highway during first multiplexed 
periods for allowing a reduced size image representa- 65 
tive of a selected first image plane to be reproduced into 
a second image plane for subsequent display during 
second time multiplexed periods. 
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13. A system according to claim 12, wherein the 
accessing means is adapted to route data corresponding 
to an accessed area within the selected image plane for 
display separately but concurrently with the reduced 
size image of the entire images plane and for incorporat- 
ing a border within the compressed image correspond- 
ing to the accessed area. 

14. A system according to claim 1, wherein the con- 
trol means includes a fixed delay device to provide a 
fixed delay between the commencement of the store 
reading and writing operations whereby the system 
operates synchronously but with a fixed time differen- 
tial. 

15. A system according to claim 14, wherein the 
delay device is adapted to provide a delay equivalent to 
a fixed number of picture point clock periods. 

16. A system according to claim 14, wherein a first 
and second bidirectional bus is provided having a fixed 
time relationship relative to the store system write cy- 
cles and read cycles respectively to allow additional 
access to the data for further manipulation, for feeding 
backwards for additional storage or for feeding for- 
wards without intermediate frame storage. 

17. A system according to claim 16, wherein the 
number of first and second bi-directional buses provided 
corresponds to the number of input or output ports. 

18. A system according to claim 16, including at least 
one picture point processor connected between the first 
and second buses so as to gain access to both incoming 
data and previously stored data to produce a compati- 
bly timed output dependent on data received from at 
least one of the buses: 

19. A system according to claim 18, wherein the 
processor is adapted to have access to the system output 
via the buses to allow the processed output to be passed 
to the system output without intermediate frame stor- 
age. 

20. A system according to claim 18, wherein the at 
least one processor is adapted to provide recursive pro- 
cessing of previously stored data with incoming data 
having the same timing relationship to effect temporal . 
filtering. 

21. A system according to claim 18, wherein the at 
least one processor is adapted to manipulate data from 
adjacent picture points within a field to effect spatial 
filtering. 

22. A system according to claim 18, wherein the at 
least one processor is adapted to operate as a multiplier. 

23. A system according to claim 18, wherein the at 
least one processor comprises a look up table for effect- 
ing a transfer function dependent on the data received 
at its input. 

24. A system according to claim 23, wherein the look 
up table is adapted to allow any frame store to operate 
as a graphics store. 

25. A system according to claim 16, wherein a bypass 
device is provided between the first and second buses to 
allow retimed data to pass therebetween. 

26. A system according to claim 1, including a con- 
trol bus for receiving control data and control selector 
means for receiving video or instructional data previ- 
ously stored in the frame stores to provide data so as to 
effect control of the system processing via the control 
bus in dependence on the data received. 

27. A system according to claim 26, wherein the 
control selector means include a plurality of bit selec- 
tors and a look up table for selecting a specified func- 
tion. 
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28. A system according to claim 1, including a high 
speed processor and wherein a manipulating data bus is 
provided to allow the processing means and the high 
speed processor to independently gain access to data 
over a time multiplex basis. 

29. A system according to claim 28, wherein the high 
speed processor comprises a programmable bit slice 
microprocessor. 

30. A video image processing system comprising: 
a plurality of frame stores each capable of storing 

data equivalent to a frame of video information; 
means for applying video data to said frame stores so 
that data information relating to different image 
frames are stored in different ones of said frame 
stores; 

means for selectively reading data from said frame 
stores to derive signals from a group of said frame 
stores, which derived signals constitute a desired 20 
output frame of video information; 

said means for selectively reading including presetta- 
ble means for selecting data from storage positions 
in said group of frame stores determined by the 
setting of said presettable means and so related that 25 
said desired output frame is built up of video infor- 
mation relating to adjacent areas of the different 
frames stored in said group of frame stores. 

31. A video image processing system according to 30 
claim 30, further comprising: 

means for setting up signals defining at least one 
image plane comprising at least said group of frame 
stores; 

said presettable means comprising means for provid- 
ing offset signals determining a point in said image 
plane which locates said desired output frame with 
respect to said image plane; and 

said means for selectively reading being responsive to 
said offset signals. 

32. A video image processing system according to 
claim 31, further comprising: 

a video information compressor; 

means for reading data from said group of frame 45 
stores to said compressor; 
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said compressor operating to reduce said last-men- 
tioned data to data capable of being stored in a 
single frame store; and 

means for displaying said compressed data in a single 
frame of video information. 

33. A video image processing system comprising: 

a plurality of frame stores each capable of storing 

data equivalent to a frame of video information; 
a video processor, for processing data so as to modify 

said video information; 
means for applying processed data from said video 

processor to a selected one of said frame stores; 
means for applying input data to said video processor; 
means for selectively reading data from said frame 

stores to derive data representing output video 

information; 
a data path; and 

means for connecting said data path from the output 
of another selected one of said frame stores to the 
input of the video processor, to include said video 
processor in a recursive video processing loop. 

34. A video image processing system according to 
claim 33 further comprising: 

means for deriving control data from and relating to 
video information stored in particular frame stores; 
and 

means for utilizing such control data to influence the 
operation of the video processor respective to a 
particular frame store. 

35. A video image processing system according to 
claim 33, further comprising: 

look-up tables for modifying data output from said 
frame stores so as to modify the respective video 
information; 

a further data path from the output side of each look- 
up table; and 

means for selectively connecting each said further 
data path to the output of said video processor. 

36. A video image processing system according to . 
claim 35 further comprising: 

means for deriving control data from and relating to 
video information stored in particular frame stores; 
and 

means for utilizing said control data to influence the 
output of a respective look-up table. 
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